Translation of Sign Language Finger-Spelling to Text using Image Processing
نویسنده
چکیده
It is difficult for most of us to imagine, but many who are deaf-mute rely on sign language as their primary means of communication. They, in essence, hear and talk through their hands. Sign languages are visual languages. They are natural languages which are used by many deaf-mute people all over the world. In sign language the hands convey most of the information. Hence, vision-based automatic sign language recognition systems have to extract relevant hand features from real life image sequences to allow correct and stable gesture classification. In our proposed system, we intend to recognize some very basic elements of sign language and to translate them to text. Firstly, the video shall be captured frame-by-frame, the captured video will be processed and the appropriate image will be extracted, this retrieved image will be further processed using BLOB analysis and will be sent to the statistical database; here the captured image shall compared with the one saved in the database and the matched image will be used to determine the performed alphabet sign in the language. Here, we will be implementing only American Sign Language Finger-spellings, and we will construct words and sentences with them.
منابع مشابه
Sign language recognition and translation: a multidisciplined approach from the field of artificial intelligence.
In recent years, research has progressed steadily in regard to the use of computers to recognize and render sign language. This paper reviews significant projects in the field beginning with finger-spelling hands such as "Ralph" (robotics), CyberGloves (virtual reality sensors to capture isolated and continuous signs), camera-based projects such as the CopyCat interactive American Sign Language...
متن کاملAutomated finger spelling by highly realistic 3D animation
We present the design of a new 3D animation tool for self-teaching (signing and reading) finger spelling—the first basic component in learning any sign language. We have designed a highly realistic hand with natural animation of the finger motions. Smoothness of motion (in real time) is achieved via programmable blending of animation segments. The hand is utilised by a programme that automatica...
متن کاملPersian sign language detection based on normalized depth image information
There are many reports of using the Kinect to detect hand and finger gestures after release of device by Microsoft. The depth information is mostly used to separate the hand image in the two-dimension of RGB domain. This paper proposes a method in which the depth information plays a more dominant role. Using a threshold in depth space first the hand template is extracted. Then in 3D domain the ...
متن کاملVisual Interpretation of ASL Finger Spelling using Hough Transform and Support Vector Machine
This paper proposes a vision based automated system for interpretation of American Sign Language (ASL) finger spelling using image processing. A graphical user interface is developed for the hard of hearing community to interact with normal hearing persons through hand gestures in a natural way thereby eliminating the need for an interpreter. This system does not require the user to wear any da...
متن کاملAutomatic Recognition of Auslan Finger-spelling using Hidden Markov Models
In recent years, gesture recognition has received much attention from research communities. Computer vision-based gesture recognition has many potential applications in the area of human-computer interaction as well as sign language recognition. Sign languages use a combination of hand shapes, motion and locations as well as facial expressions. Finger-spelling is a manual representation of alph...
متن کامل